-
Notifications
You must be signed in to change notification settings - Fork 660
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
chore: remove context_relevancy from library #1111
chore: remove context_relevancy from library #1111
Conversation
why do you remove context_relevancy from library? can you give me a explanation? thanks! |
that turned out to be not a useful metric, so it was under deprecation for a while. use this instead https://docs.ragas.io/en/stable/concepts/metrics/context_precision.html |
Hey, |
@zhiwei2017 that is a good point, thanks for bringing it up. Will keep this in mind moving forward! 🙂 sorry for the inconvenience |
since this has been removed, it'd be great if you could have some other reference-free evaluation metric that looks at how relevant retrieved context is to answer an input. Could you also expand on why context relevancy "turned out to be not a useful metric" meriting its removal? |
@shahules786 could you help @mongodben out? |
Hi @mongodben thanks for the suggestions. |
No description provided.